Complexity of Proximal Augmented Lagrangian for Nonconvex Optimization with Nonlinear Equality Constraints
نویسندگان
چکیده
We analyze worst-case complexity of a Proximal augmented Lagrangian (Proximal AL) framework for nonconvex optimization with nonlinear equality constraints. When an approximate first-order (second-order) optimal point is obtained in the subproblem, $$\epsilon $$ original problem can be guaranteed within $${\mathcal {O}}(1/ \epsilon ^{2 - \eta })$$ outer iterations (where $$\eta user-defined parameter \in [0,2]$$ result and [1,2]$$ second-order result) when proximal term coefficient $$\beta penalty $$\rho satisfy = {\mathcal {O}}(\epsilon ^\eta )$$ \varOmega (1/\epsilon , respectively. also investigate total iteration operation Newton-conjugate-gradient algorithm used to solve subproblems. Finally, we discuss adaptive scheme determining value that satisfies requirements analysis.
منابع مشابه
An Augmented Lagrangian Based Algorithm for Distributed NonConvex Optimization
This paper is about distributed derivative-based algorithms for solving optimization problems with a separable (potentially nonconvex) objective function and coupled affine constraints. A parallelizable method is proposed that combines ideas from the fields of sequential quadratic programming and augmented Lagrangian algorithms. The method negotiates shared dual variables that may be interprete...
متن کاملNonlinear Robust Optimization with Uncertain Equality Constraints
The problem of nonlinear optimization for process design under uncertainty is addressed in this paper. A novel robust optimization framework is proposed to address general nonlinear problems under uncertainty. To address the limitation of single point linearization with respect to uncertain parameters for a large uncertainty region, an iterative algorithm is developed. The new method applies lo...
متن کاملAdaptive Augmented Lagrangian Methods for Large-Scale Equality Constrained Optimization
We propose an augmented Lagrangian algorithm for solving large-scale equality constrained optimization problems. The novel feature of the algorithm is an adaptive update for the penalty parameter motivated by recently proposed techniques for exact penalty methods. This adaptive updating scheme greatly improves the overall performance of the algorithm without sacrificing the strengths of the cor...
متن کاملAn augmented Lagrangian trust region method for equality constrained optimization
In this talk, we present a trust region method for solving equality constrained optimization problems, which is motivated by the famous augmented Lagrangian function. It is different from standard augmented Lagrangian methods where the augmented Lagrangian function is minimized at each iteration. This method, for fixed Lagrange multiplier and penalty parameters, tries to minimize an approximate...
متن کاملAugmented Lagrangian Duality and Nondifferentiable Optimization Methods in Nonconvex Programming
Abstract. In this paper we present augmented Lagrangians for nonconvex minimization problems with equality constraints. We construct a dual problem with respect to the presented here Lagrangian, give the saddle point optimality conditions and obtain strong duality results. We use these results and modify the subgradient and cutting plane methods for solving the dual problem constructed. Algorit...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Scientific Computing
سال: 2021
ISSN: ['1573-7691', '0885-7474']
DOI: https://doi.org/10.1007/s10915-021-01409-y